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This  chapter  discusses  recent  efforts  at  developing  mechanisms  for  capturing  the  effects  of  fatigue  on 
human  performance.  We  describe  a  computational  cognitive  model,  developed  in  ACT-R,  that  per¬ 
forms  a  sustained  attentional  task  called  the  psychomotor  vigilance  task  (PVT).  We  use  neurobehavioral 
evidence  from  research  on  sleep  deprivation,  in  addition  to  previous  research  from  within  the  ACT-R 
community,  to  select  and  to  evaluate  a  mechanism  for  producing  fatigue  effects  in  the  model.  Fatigue  is 
represented  by  decrementing  a  parameter  associated  with  arousal  in  ACT-R,  while  also  reducing  a  thresh¬ 
old  value  in  the  architecture  to  capture  attempts  at  compensating  for  the  negative  effects  of  decreased 
arousal.  These  parameters  are  associated  with  the  production  utility  computation  in  ACT-R,  which  con¬ 
trols  the  selection/execution  cycle  to  determine  which  production  (if  any)  to  execute  on  each  cognitive 
cycle.  In  ACT-R,  this  mechanism  is  linked  to  the  basal  ganglia  and  the  thalamus.  In  turn,  portions  of  the 
thalamus  show  heightened  activation  in  attentional  tasks  under  conditions  of  sleep  deprivation.  The  model 
we  describe  closely  captures  the  performance  of  human  participants  on  the  PVT,  as  observed  in  a  labo¬ 
ratory  experiment  involving  88  hours  of  total  sleep  deprivation. 


Until  recently,  computational  cognitive  models  of 
human  performance  were  developed  with  little  consid¬ 
eration  of  how  factors  such  as  emotions  and  alertness 
influence  cognition.  However,  with  increased  sophisti¬ 
cation  in  models  of  cognitive  systems,  advances  in  com¬ 
puter  technology,  and  pressure  for  ever  more  realistic 
representations  of  human  performance,  cognitive  mod¬ 
erators  are  emerging  as  an  important  area  of  research 
within  the  field  of  computational  modeling  (e.g., 
Gratch  &  Marsella,  2004;  Hudlicka,  2003;  Ritter, 
Reifers,  Klein,  Quigley,  &  Schoelles,  2004).  There  is  a 
sense  in  which  this  development  is  both  premature 
and  long  overdue.  Evidence  for  its  prematurity  can  be 
found  in  many  of  the  other  chapters  in  this  volume. 
Cognitive  science  has  yet  to  unravel  many  of  the  intri¬ 
cacies  of  “normal”  human  cognition.  Therefore,  adding 
additional  complexity  by  including  cognitive  moderators 
that  influence  those  thought  processes  constitutes  a 
substantial  challenge.  However,  cognitive  moderators 
are  pervasive  in  human  cognition.  It  seems  essential, 
therefore,  that  they  be  considered  in  attempts  to 


understand  human  cognitive  ftmetions.  If  cognitive 
architectures  are  to  be  viewed  as  “unified  theories  of 
cognition”  (Newell,  1990),  then  they  must  include 
mechanisms  to  represent  those  factors  that  have  sub¬ 
stantial  modulatory  effects  on  cognitive  performance. 

This  chapter  describes  an  effort  to  introduce  a  theory 
of  degraded  cognitive  functioning  into  the  adaptive 
control  of  thought-rational,  or  ACT-R,  cognitive  archi¬ 
tecture.  In  this  case,  the  degradation  arises  from  the 
combined  effect  of  sleep  deprivation  and  endogenous 
circadian  variation.  We  describe  a  computational  cog¬ 
nitive  model  that  incorporates  mechanisms  to  repre¬ 
sent  decrea.sed  alertness  and  describe  the  impact  of 
those  mechanisms  on  the  model’s  performance  on  the 
psychomotor  vigilance  task  (PVT),  a  sustained  atten¬ 
tion  task  that  has  been  extensively  validated  to  be  sen¬ 
sitive  to  variation  in  sleep  homeostatic  and  circadian 
dynamics,  while  being  relatively  immune  to  the  effects 
of  aptitude  and  learning  (Dorrian,  Rogers,  &  Dinges, 
2005).  Our  modeling  effort  draws  on  recent  research 
on  partial  and  total  sleep  deprivation  (e.g..  Van  Dongen 


243 


Report  Documentation  Page 


Form  Approved 
0MB  No.  0704-0188 


Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 
VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  0MB  control  number. 


1.  REPORT  DATE 


4.  TITLE  AND  SUBTITLE 


2.  REPORT  TYPE 

Book  Chapter 


Decreased  Arousal  as  a  Result  of  Sleep  Deprivation  The 
Unraveling  of  Cognitive  Control 


3.  DATES  COVERED 

00-10-2004  to  00-10-2006 

5a.  CONTRACT  NUMBER 

F41624-97-D-5000  TO  23 


5b.  GRANT  NUMBER 


5c.  PROGRAM  ELEMENT  NUMBER 


62202F 


6.  AUTHOR(S) 

Glenn  Gunzelmann;  Kevin  Gluck;  Scott  Price;  Hans  Van 
Dongen;  David  Dinges 


5d.  PROJECT  NUMBER 


5e.  TASK  NUMBER 


5f.  WORK  UNIT  NUMBER 

1123AS06;2313HA09 


AFRL;  AFRL/RHA 


10.  SPONSOR/MONITOR’S  ACRONYM(S) 

AFRL;  AFRL/RHA 

11.  SPONSOR/MONITOR’S  REPORT  NUMBER(S) 

AFRL-RH-AZ-BC-2007-0001 


7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES)  8.  PERFORMING  ORGANIZATION  REPORT  NUMBER 

Air  Force  Research  Lahoratory/RHA, Warfighter  Readiness  AFRL;  AFRL/RHA 

Research  Division, 6030  South  Kent  Street, Mesa, AZ, 85212-6061 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES)  10.  SPONSOR/MONITOR’S  ACRONYM(S) 

Air  Force  Research  Lahoratory/RHA,  Warfighter  Readiness  AFRL;  AFRL/RHA 
Research  Division,  6030  South  Kent  Street,  Mesa,  AZ, 

11.  SPONSOR/MONITOR’S  REPORT  NUMBER(S) 

AFRL-RH-AZ-BC-2007-0001 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distrihution  unlimited 

13.  SUPPLEMENTARY  NOTES 

Published  as  Chapter  17  in  W.  Gray  (Ed.),  Integrated  models  of  cognitive  systems  (pp.  243-253).  New  York 
NY :  Oxford  University  Press 

14.  ABSTRACT 

This  chapter  discusses  recent  efforts  at  developing  mechanisms  for  capturing  the  effects  of  fatigue  on 
human  performance.  We  describe  a  computational  cognifive  model  developed  in  ACT-R,  that  performs  a 
sustained  attentional  task  called  the  psychomotor  vigilance  (PVT).  We  use  neurobehavioral  evidence  from 
research  on  sleep  deprivation,  in  addition  to  previous  research  from  within  the  ACT-R  community,  to 
select  and  to  evaluate  a  mechanism  for  producing  fatigue  effects  in  the  model.  Fatigue  is  represented  by 
decrementing  a  parameter  associated  with  arousal  in  ACT-R,  while  also  reducing  a  threshold  value  in  the 
architecture  to  capture  attempts  at  compensating  for  the  negative  effects  of  decreased  arousal.  These 
parameters  are  associated  with  the  production  utility  computation  in  ACT-R,  which  controls  the 
selection/execution  cycle  to  determine  which  production  (if  any)  to  execute  on  each  cognitive  cycle.  In 
ACT-R,  this  mechanism  is  linked  to  the  basal  ganglia  and  the  thalamus.  In  turn,  portions  of  the  thalamus 
show  heightened  activation  in  attentional  tasks  under  conditions  of  sleep  deprivation.  The  model  we 
describe  closely  captures  the  performance  of  human  participants  on  the  PVT,  as  observed  in  a  laboratory 
experiment  involving  88  hours  of  total  sleep  deprivation. 


15.  SUBJECT  TERMS 

Arousal;  Sleep  deprivation;  Cognitive  control;  Fatigue;  Human  performance;  Computational  cognitive 
process  modeling;  Psychomotor  vigilance  task; 


16.  SECURITY  CLASSIEICATION  OF: 

17.  LIMITATION 

18.  NUMBER 

19a.  NAME  OF  RESPONSIBLE 

OF  ABSTRACT 

OF  PAGES 

PERSON 

a.  REPORT 

unclassified 

b.  ABSTRACT 

unclassified 

c.  THIS  PAGE 

unclassified 

Public 

Release 

10 

Standard  Form  298  (Rev.  8-98} 

Prescribed  by  ANSI  Std  Z39-18 


244  INTEGRATING  EMOTIONS,  MOTIVATION,  AROUSAL  INTO  MODELS  OF  COGNITIVE  SYSTEMS 


et  al.,  2003),  and  leverages  recent  advances  in  under¬ 
standing  how  sleep  deprivation  impacts  neiirobehav- 
ioral  and  brain  functioning  (e.g.,  Drummond  et  al., 
1999,  2000;  Drummond,  Gillin,  &  Brown  2001;  Habeck 
et  al.,  2004;  Portas  et  al.,  1998). 

In  the  sections  that  follow,  we  describe  relevant 
research  related  to  sleep  loss.  1’his  is  followed  by  a  des¬ 
cription  of  the  PVT  and  then  the  ACT-R  model  we  have 
developed  to  perform  it.  We  use  the  model  to  demon¬ 
strate  the  effectiveness  of  our  approach  for  capturing  per¬ 
formance  decrements  as  a  function  of  sleep  deprivation. 
In  describing  the  model,  we  suggest  some  alternative 
mechanisms  to  illustrate  how  the  effects  of  sleep  depri¬ 
vation  can  be  seen  as  resulting  from  impacts  to  either 
central  control  (Type  1  control)  or  the  internal  control 
of  functional  processes  (Type  2  control),  which  includes 
processes  like  hiemory  retrieval  or  programming  motor 
movements.  This  distinction  constitutes  a  major  theme 
of  this  book.  Although  the  mechanistic  explanation  for 
the  effects  of  sleep  deprivation  w'e  have  developed  is  not 
explicitly  defined  in  terms  of  Type  1  or  Type  2  control, 
the  discussion  illustrates  how  the  Tiiodeling  effort  is 
improved  through  consideration  of  this  distinction. 

Neuropsychological  Research 
on  Sleep  Deprivation 

Unquestionably,  sleep  deprivation  has  a  negative  effect 
on  human  performance  aeross  a  wide  array  of  tasks 
and  situations.  Determining  the  particular  impacts  of 
sleep  deprivation,  both  behaviorally  and  physiologi¬ 
cally,  has  been  a  significant  topic  of  study  in  psycho¬ 
logical  and  medical  research  for  quite  some  time 
(e.g.,  Patrick  &  Gilbert,  1896;  von  Economo,  1930). 
Researeh  originally  focused  on  identifying  the  nature 
of  neurobehavioral  incapacitation  but  shifted  to  changes 
in  cognitive  performance  when  early  studies  did  not 
provide  conclusive  evidence  that  sleep  loss  eliminated 
the  ability  to  perform  specific  tasks  (e.g.,  Kleitman, 
1923;  Lee  &  Kleitman,  1923).  Gurrent  research  direc¬ 
tions  have  been  motivated  by  the  desire  to  uncover  the 
neurophysiologic  mechanisms  that  produce  diminished 
alertness  and  decrements  in  cognitive  performance,  as 
well  as  any  compensatory'  mechanisms.  Research  eval¬ 
uating  behavioral,  pharmacological,  and  technological 
countermeasures  to  offset  deficits  of  sleep  deprivation 
has  also  been  a  long-standing  focus  of  research  (e.g.. 
Bonnet  et  al.,  2005;  Galdw'ell,  Galdwell,  &  Darlington 
2003;  Caldwell,  Caldwell,  Smith,  &  Brown,  2004; 
Dinges  &  Broughton,  1989). 


At  the  cortical  level,  studies  have  shown  inconsis¬ 
tent  patterns  of  regional  activation  responses  to  sleep 
deprivation,  depending  on  the  type  of  cognitive  task, 
its  difficulty',  and  the  method  used  to  measure  activa¬ 
tion  (e.g..  Ghee  &  Choo,  2004;  Drummond  et  al., 
1999,  2001;  Habeck  et  al.,  2004).  At  the  subcortical 
level,  a  main  area  that  consistently  shows  sensitivity 
to  sleep  deprivation  is  the  thalamus  (Ghee  &  Choo, 
2004;  Habeck  et  al.,  2004;  Lin,  2000;  Portas  et  al., 
1998).  The  thalamus  typically  shows  an  increase  in 
activation  when  individuals  are  asked  to  perform  a  task 
w'hile  sleep  deprived,  relative  to  performing  the  task 
when  well  rested.  For  instance,  Portas  et  al.  (1998) 
asked  participants  to  perforin  a  short-duration  attention 
task  while  activity  was  measured  using  fMRI.  They 
found  that  the  thalamus  showed  increased  activation 
while  performing  the  attention  ta.sk  under  conditions 
of  sleep  loss,  while  overall  performance  (response  time) 
was  not  significantly  different  from  baseline.  From  these 
results,  they  concluded,  “This  process  may  represent  a 
sort  of  compensatory  mechanism.  .  .  .  We  speculate 
that  the  thalamus  has  to  ‘work  harder’  in  conditions  of 
low  arousal  to  achieve  a  performance  that  is  e(|ual  to 
that  obtained  during  normal  arousal"  (p.  8987).  The 
possibility  of  such  a  compensatory  mechanism  involv¬ 
ing  the  thalamus  is  discussed  further  in  the  section  on 
the  computational  model  later  in  this  chapter. 

Biomathematical  Models 
of  Sleep  Deprivation 

In  addition  to  the  significant  progress  that  has  been  made 
in  understanding  the  neurobehavioral  mechanisms  of 
sleep  deprivation,  researchers  studying  fatigue  have 
also  developed  biomathematical  models  that  reflect 
the  influence  of  sleep  history  and  circadian  rhythms 
on  overall  cognitive  performance,  or  alertness  (Mallis, 
Mejdal,  Nguyen,  &  Dinges,  2004).  Such  models  pro¬ 
vide  a  means  for  describing  the  dynamic  interaction  of 
these  factors.  For  instance.  Figure  17.1  shows  the  pre¬ 
dictions  for  one  of  these  models,  the  circadian  neuro¬ 
behavioral  performance  and  alertness  (CNPA)  model 
(jewelt  &  Kronauer,  1999),  for  a  protocol  involving  88 
hr  of  total  sleep  deprivation.  The  circadian  rhythm 
component  of  the  model  is  responsible  for  the  cyclic 
nature  of  the  predictions  and  increased  sleep  loss  is 
responsible  for  the  overall  decline  across  days. 

Although  there  is  room  for  improvement  in  all  cur¬ 
rent  biomathematical  models  of  performance  (Van 
Dongen,  2004),  the  models  have  potential  value  for 
predicting  global  changes  in  alertness  over  time  in  a 
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riCuiRE  17.1  Predictions  of  alerlne.ss  from  the  eireadiaii  ncuroheliavioral 
performance  and  alertness  (CNPA)  model  for  a  study  involving  88  eontinnous 
hours  awake,  beginning  al  7:30  a.m.  on  the  haseline  dav. 


varieh'  of  circumstances.  1  lowescr,  a  key  limitation  is 
that  these  models  do  not  make  predictions  of  how 
changes  in  alertness  will  affect  performance  on  partic¬ 
ular  tasks  (e.g.,  changes  in  response  limes  or  changes 
ill  tvpes  or  frequencies  of  errors).  Phe  fits  described  in 
Van  Dongen  (2004)  were  produced  by  scaling  the 
alertness  predictions  to  minimize  the  deviation  from 
the  data.  These  values  had  to  he  computed  post  hoc. 
So,  while  the  predictions  from  the  models  approxi¬ 
mate  relatise  changes  in  performance,  they  do  not 
actually  provide  a  priori  estimates  of  how  much 
response  times  will  change  in  absolute  magnitude  or 
how  errors  will  increase  over  lime. 

The  compulatioual  cognitive  modeling  research 
described  in  this  chapter  w  ill  eventually  allow  us  to 
bridge  the  gap  between  biomathematical  models  and 
complex  cognitive  task  performance,  ('ompiitalional 
cognitive  models  make  detailed  predictions  about 
human  performance,  including  response  times  and 
errors.  The  goal  of  the  project  is  to  use  the  predictions 
from  the  biomathematical  models  lo  drive  changes  in 
mechanisms  in  the  A(7T-R  cognitive  architecture.  In 
this  wav,  the  predictions  of  the  bioniatheinalical  model 
can  be  used  lo  produce  parameter  changes  in  the  cog¬ 
nitive  model,  which  can  be  u.scd  to  make  specific  pre¬ 
dictions  about  how  human  performance  declines  as  a 
function  of  fatigue.  .Although  this  latter  goal  has  not  yet 
been  reached,  this  chapter  describes  Ihe  progress  we 
have  made  toward  it,  especially  the  determination  of  a 
set  of  mechanisms  in  .\CT-R  lo  account  for  changes  in 
alertness.  'These  mechanisms  are  demonstrated  in  the 
context  of  Ihe  PVn’,  which  is  described  next. 


Psychomotor  Vigilance  Task 

Ihe  psvehomotor  vigilance  task  (PV"T;  Dinges  &• 
Powell,  1^85)  assesses  vigilaul/sustained  attention  and 
has  been  icscd  frcqnentlv  in  sleep  deprivation  research. 
Its  main  advantages  are  that  performance  is  both  sensi¬ 
tive  to  the  levels  of  sleep  deprivation  and  relatively 
insensitive  lo  either  aptitude  or  learning  (Dorrian  et  al., 
2005).  During  a  tspieal  PVT  trial,  a  slinuilus  appears 
in  a  prespecified  location  on  a  monitor  al  random 
intervals  between  2  s  and  10s.  The  subject’s  task  is  to 
press  a  response  bulton  as  fast  as  possible  each  lime  a 
slinudus  appears  but  not  to  pre.ss  the  bulton  too  soon. 
When  the  response  bulton  is  pressed,  the  visual  stimu¬ 
lus  displays  reaction  time  in  milliseconds  to  inform  Ihe 
subject  of  how  well  they  performed.  The  duration  of  a 
test  session  is  typically  10  miu. 

1  he  data  from  a  PV''T  session  consist  of  approxi¬ 
mately  90  responses,  which  can  be  classified  to  facili¬ 
tate  understanding  how  P\'T  pcrtormauce  changes  as 
fatigue  increases  (Dorrian  el  al.,  2005).  The  range  for 
Ihe  first  category,  which  we  will  refer  to  as  “alert” 
responses,  is  between  1 50  ms  a)id  500  ms  after  slinuilus 
onset  (median  is  Ispically  around  250ms),  indicative 
of  a  participant  that  is  responding  about  as  rapidly  as 
ncnrologically  possible  to  each  slinuilus.  Responses 
greater  than  500  ms  but  less  than  30.000 ms  (i.e.,  30s) 
are  considered  lo  be  “lapses”  of  attention  (errors  of 
omission;  Dinges  &  Kribbs,  1991;  Dorrian  et  al.,  2005). 
These  responses  indicate  that  attention  is  wavering 
from  Ihe  display,  but  that  participants  are  recovering  at 
some  point  lo  delect  the  stimulus.  In  some  instances. 
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participants  fail  to  respond  even  after  TOs,  whicli  is  a 
dramatic  breakdown  in  performance  that  is  classified 
as  a  “sleep  attack”  (Dorrian  et  al.,  2U05).  In  these  cases, 
the  experimenter  intervenes  to  wake  the  participant.  ;\t 
the  opposite  end  of  the  response-time  continimm  are 
“false  starts"  (errors  of  commission),  which  arc  respon.ses 
that  occur  before  the  stimnins  appears,  or  within  1 50  ms 
of  the  stimnins  onset  (i.e.,  nenrologically  loo  fast  to  be 
a  normal,  alert  respon.se).  ’I  hese  responses  represent 
anticipation  of  the  stimulus’s  appearance. 

As  .sleep  deprivation  increases,  the  proportion  of  alert 
responses  decreases,  and  the  distribution  of  reaction 
times  .shifts  to  the  right,  resulting  in  increased  propor¬ 
tions  of  lapses  and  sleep  attacks.  As  participants  attempt 
to  compensate  based  on  feedback  that  they  arc  lapsing 
(errors  of  omission)  more  frequently,  the  proportion  of 
false  starts  (errors  of  commission)  increases  as  w'cll 
(Doran,  Van  Dongen,  &  Dinges,  2001).  A  sample  set 
of  data  from  the  PV^I’  is  shmvn  in  Figure  17.2  (these 
data  are  from  Van  Dongen,  2004;  Van  Dongen  ct  ah, 
2001).  In  the  experiment  that  provided  the  data,  par¬ 
ticipants  first  spent  three  nights  in  the  laboratory  to 
acclimate  to  a  common  sleep  cycle  of  8  hr  for  sleep  per 
day.  After  this,  participants  were  kept  awake  continu¬ 
ously  for  88 hr,  until  near  midnight  on  the  fourth  day. 
This  is  the  same  protocol  that  was  u.sed  to  generate  the 
CNPA  predictions  in  Figure  17.1,  which  shows  alert¬ 
ness  predictions  for  the  last  day  of  acclimation  and  for 


the  88-hr  sleep-deprivation  period.  The  first  day  of  this 
period,  during  which  tio  actual  sleep  loss  was  yet 
incurred,  was  used  as  a  baseline  day.  Beginning  at 
7:30  a.m.  on  the  baseline  day,  participants  completed 
a  series  of  tasks,  including  the  PVT,  repeatedly  in  2-hr 
cycles  (the  set  of  tasks  took  approximately  30  min  to 
complete).  Note  that  the  OVl'data  shown  in  Figure  17.2 
arc  averaged  over  sessions  performed  within  each  day 
of  the  protocol,  w'hereas  the  CNPA  data  in  Figure  17.1 
illustrate  the  dynamic  changes  in  alertness  that  occur 
within  each  of  the  days  (circadian  rhythms). 

The  next  section  describes  the  computational  cog¬ 
nitive  model.  The  model  represents  the  first  .step  in 
developing  the  capabilih’  to  make  detailed  a  priori 
predictions  about  changes  in  human  performance  on 
particular  tasks  as  a  function  of  increa.sed  levels  of 
fatigue,  riie  model  performs  the  PVT,  and  parameter 
changes  in  the  model  impact  performance  in  a  man¬ 
ner  similar  to  human  performance  under  conditions  of 
sleep  deprivation. 

Computational  Cognitive  Model 

The  computational  model  described  in  this  chapter 
was  developed  in  the  ACT-R  5  cognitive  architecture 
(Anderson  el  ah,  2004).  Here  we  will  describe  only 
the  ACT-R  mechanisms  that  are  associated  with  the 


HcuiRF.  17.2  I  Inman  performance  on  the  psychomotor  vigilance  task.  Data  are 
from  a  study  where  participants  were  kept  awake  for  88  continuons  hours,  while 
performing  a  battery  of  tests  every  2  hr  (data  from  Van  Dongen  et  ah,  2001;  Van 
Dongen  2004).  .Averages  across  test  sessions  w  ithin  each  day  are  shown. 
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parameters  that  were  manipulated  to  alter  the  architec¬ 
ture’s  level  of  alertness,  which  produces  the  perform¬ 
ance  decrements  exhibited  by  the  model. 

We  have  constrained  the  selection  of  appropriate 
parameters  and  mechanisms  for  this  effort  in  several 
ways.  For  instance,  we  have  taken  into  account  previous 
research  in  the  AC'I'-R  commnnity  (Belavkin,  2001; 
Jonginan,  1998),  and  we  have  used  the  conclusions 
from  neuropsychological  research  on  the  effect  of  sleep 
deprivation  on  the  functioning  of  various  brain  areas, 
particularly  the  thalamus  (Chee  &  Choo;  Habcck  et  al., 
2004;  Portas  et  al.,  1998).  To  n.se  the  conclusions  from 
this  work,  we  leveraged  recent  advances  in  the  devel¬ 
opment  of  the  AC1-R  architecture,  which  have  included 
mapping  its  components  to  brain  areas  (Anderson, 
chapter  4,  this  volume).  This  mapping  establishes  a 
“common  space,"  where  links  between  neuropsycho¬ 
logical  research  on  fatigue  can  Ire  putatively  linked  with 
aspects  of  the  arcliitcchire.  The  constraints  imposed  by 
this  research  implicate  a  mechanism  in  AC'l’-R  that  is 
related  to  the  production  seicction/execution  cycle  as 
a  candidate  for  being  impacted  by  fatigue.  This  process 
is  associated  with  the  basal  ganglia  and  the  thalamus  in 
the  current  conceptual i/ation  of  ACT-R  (Figure  17.8). 

The  production/execulion  cycle  involves  evaluating 
alternative  productions  and  then  selecting  the  “best” 
among  them.  During  the  selection  process,  produc¬ 
tions  are  compared  using  a  value  called  expected  utility 
(Uj),  which  is  calculated  for  each  candidate  produc¬ 
tion  using  the  equation: 

U-  =  P,G  -  q  +  e 

In  this  equation,  P-  is  the  probability  of  success  if  pro¬ 
duction,  is  used  and  C,-  is  the  anticipated  cost.  In  gen¬ 
eral,  G  has  been  termed  the  value  of  the  goal.  1  lowcver. 


Production  Execution  Cycle  in  ACT-R 

(including  hypothesized  mapping  to  brain  areas) 


HGURE  17.8  Production  execution  cycle  in  the  adaptive 
control  of  thought-rational  (ACT-R)  cognitive  archi¬ 
tecture,  including  hypothesized  mapping  to  brain 
areas.  The  expected  utilit}'  equation  is  associated  with 
the  selection  component  of  this  process,  while 
execution  is  controlled  by  the  utility  threshold  (TJ. 
Adapted  from  htt^)://actr.psy.cmu.cdu/. 


the  research  cited  above  uses  the  G  parameter  to  capture 
the  influence  of  aroirsal  on  pertormance  (Belavkin, 
2001;  jonginan,  1998).  Wc  use  this  conceptualization 
of  G  in  onr  model  as  well.  Noise  (e)  is  added  to  the  cal¬ 
culation  to  add  a  stochastic  component  to  the  value. 
'Ihc  noise  is  sampled  from  a  Gaussian  distribution  with 
a  mean  of  0  and  a  variance  of  about  0.21.’  A  value  for 
q  is  calculated  for  each  production,  that  matches  the 
current  state  on  each  production  cycle.  'Ihe  production^ 
with  the  highest  value  for  q  is  selected. 

Once  a  production  is  selected,  the  next  step  is  exe¬ 
cution.  This  process  is  associated  with  the  thalamus  in 
ACTR  (Figure  17.8).  Production  execution  is  con¬ 
trolled  by  a  parameter  called  the  utility  threshold,  'I'^. 
The  selected  production  is  executed,  provided  that  L/, 
exceeds  T„.  If  it  docs  not,  no  production  is  executed 
and  the  model  is  “idle”  for  the  duration  of  that  produc¬ 
tion  cycle  (approximately  50  ms).^  The  neuropsycho¬ 
logical  data  suggest  that  fatigue  may  indirectly  affect 
this  process,  with  individuals  trying  to  offset  the  adverse 
effects  through  an  attempt  at  compensation  (Portas 
et  al.,  1998).  As  the  behavior  of  the  model  illustrates, 
some  compensation  may  be  possible,  but  it  does  not 
completely  offset  the  negative  effects  associated  with 
sleep  loss. 

We  find  it  encouraging  that  research  on  the  ncu- 
robchavioral  effects  of  fatigue  and  research  within  the 
AC’I'-R  community  both  point  to  a  common  mecha¬ 
nism  for  capturing  fatigue  effects  in  ACT-R.  The  con¬ 
vergence  of  this  research  on  the  production  selection/ 
execution  cycle  in  ACT-R  indicates  that  one  of  the 
impacts  of  fatigue  may  be  a  decreased  likelihood  of 
successfully  executing  an  appropriate  sequence  of  pro¬ 
ductions.  This  entails  both  an  increased  likelihood  of 
having  cognitive  cycles  where  the  system  is  idle  as  well 
as  the  execution  of  inappropriate  productions.  Next  wc 
describe  the  model  wc  constructed  in  AC  I-R,  which  is 
based  on  this  conceptualization  of  the  impact  of  fatigue. 

Model  Design 

Because  the  PVl  is  simple  in  design,  the  ACT-R  model 
is  relatively  straightforward.  Before  the  stimulus  appears 
the  model  can  (1)  deliberately  wait  for  the  stimulus  or 
(2)  errantly  make  a  response  (a  false  start).  Once  the 
stimulus  has  appeared,  the  model  can  (1)  attend  to  the 
stimulus  and  then  respond  (this  is  two  productions)  or 
(2)  res|X)nd  without  attending  the  stimulus  (a  false  start 
that  happens  to  come  after  the  stimulus  apjrears  and  is 
therefore  counted  as  an  appropriate  response).  At  any 
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point  in  the  task,  it  is  possible  for  the  model  to  be  idle 
for  one  or  more  cognitive  cycles. 

Ifor  nearly  all  the  productions  in  the  model,  iT  was 
set  to  1,  meaning  that  the  goal  would  be  achieved  suc- 
ce.ssfully  if  that  production  was  fired.  The  lone  excep¬ 
tion  to  this  was  the  production  that  errantly  responds. 
Pj  for  this  production  was  0,  on  the  assumption  that  it 
is  highly  unlikely  to  result  in  achieving  the  goal  of  suc¬ 
cessfully  responding  to  the  stimulus.  The  coirsequence 
of  this  is  a  reduced  likelihood  of  that  production  firing 
relative  to  the  other,  appropriate  productions,  since  LT 
becomes  a  negative  value  (-CT  ).  However,  with  noise 
added  to  the  utility'  computation,  this  production  is 
occasionally  the  one  with  the  highest  LT  and  also  ri.ses 
above  T,,. 

To  produce  decrements  in  performance  like  those 
associated  with  sleep  deprivation,  we  conceptualized 
increased  sleep  deprivation  as  resulting  in  decreased 
arousal.  Therefore,  we  implement  fatigue  in  ACT-R  by 
decreasing  the  G  parameter,  in  line  with  previous 
research  within  the  AC  T-R  community  (Belavkin,  2001; 
)ongman,  1098).  Reducing  the  value  of  C  decreases  IT 
for  all  productions,  where  is  greater  than  0.  This 
makes  it  more  likely  that  the  expected  utilities  for  those 
productions  will  fall  below  T,,,  thereby  making  them 
less  likely  to  fire.  In  turn,  this  increases  the  probability' 
of  idle  cognitive  cycles.  A  key  feature  of  this  mecha- 
ni.sm  is  that  idle  cycles  actually  become  more  likely 
than  appropriate  actions  once  IT  (before  noise  is  added) 
falls  below  T,^,  which  happens  after  the  first  full  day  of 
total  sleep  deprivation. 

In  addition  to  the  decreased  aron.sal  that  is  associated 
with  sleep  loss,  we  include  a  secondary  process  that 
can  be  viewed  as  an  attempt  to  compensate  for  the  neg¬ 
ative  effect  of  fatigue,  as  suggested  by  Portas  et  al. 
(1998).  In  ACT-R  terms,  the  increased  activity  they 
obserxed  in  the  thalamus  can  be  seen  as  an  attempt  to 
make  it  easier  for  the  selected  production  to  fire  suc¬ 
cessfully.  'The  most  natural  way  of  representing  this  in 
ACT-R  is  by  reducing  T„.  With  lower  values  for  T„, 
productions  with  increasingly  lower  IT,  values  are 


able  to  fire.  In  cases  where  there  is  an  idle  cognitive 
cycle,  new'  (.T  values  are  computed  at  the  beginning  of 
the  next  cycle  and  the  process  repeats.  The  noi.se  added 
to  the  calcidation  of  t/,  creates  the  possibility  of  all 
matching  productions  being  below  threshold  on  one 
cycle,  follow'ed  by  a  cycle  where  at  least  one  production 
rises  above  threshold. 

There  is  one  additional  component  to  the  model.  A 
mechanism  was  implemented  to  represent  the  process 
of  falling  asleep.  The  idle  cognitive  cycles  that  result 
w'hen  no  productions  rise  above  threshold  represent 
situations  where  arousal  is  so  low  that  none  of  the 
available  actions  are  executed.  As  an  individual  falls 
asleep,  the  probability  of  being  in  such  a  state  should 
increase.  In  the  model,  this  is  represented  by  having 
the  value  of  G  decrease  when  idle  cognitive  cycles 
occur  during  the  time  when  the  stimulus  is  on  the 
screen.  On  each  occasion  when  this  occurs,  C  is 
decremented  by  0.085.  'I’his  is  limited  by  the  architec¬ 
tural  requirement  that  G  remain  positive.  So,  C  is 
decremented  by  0.035  on  each  idle  cognitive  cycle, 
unless  (hat  decrement  results  in  a  negative  number,  in 
w'hich  case  C  is  set  to  a  minimum  value  of  0.0001, 
where  it  remains  stable  until  the  start  of  the  next  trial. 
This  progressively  reduces  the  probability  of  a  response 
with  each  passing  cycle  in  the  model.  The  value  of  G 
is  reset  to  the  starting  value  al  the  beginning  of  each 
trial,  reflecting  either  a  successful  response  or  being 
awakened  by  the  experimenter  after  a  sleep  attack.  'The 
values  u.sed  for  G  and  for  the  four  days  of  the  exper¬ 
iment  are  presented  in  'Table  17.1.  As  this  table  illus¬ 
trates,  G  falls  more  rapidly  than  T„,  meaning  that  the 
model’s  performance  deteriorates  across  the  four  days 
of  the  study.  The  model’s  performance  is  descrilsed  in 
more  detail  in  the  next  section. 

Model  Performance 

Ba.se!inc  performance  in  the  model  reflects  the  interplay 
of  the  knowledge  in  the  system  with  the  various  mech¬ 
anisms  described  above  using  the  parameter  values 


TABU-.  17.1  Parameter  V'alues  for  G  and  T„  in  the  ACT-R  Model  for  Llach 
Dax  in  the  Sleep  Deprixation  Protocol 


Day 

G  {Arousal) 

T|,  {Utility  Threshold) 

Baseline 

1,98 

1.84 

Day  1  of  total  slce|>  deprix  ation 

1.80 

1.78 

Day  2  of  total  sleep  deprivation 

1.6T) 

1.70 

Day  3  of  total  sleep  deprivation 

1.58 

1.64 
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identified  above  and  shown  in  Table  17.1.  All  other 
parameters  were  kept  at  their  default  ACT-R  values. 
Baseline  performance  represents  an  alert,  well-rested 
participant.  I’hc  model’s  performance  in  this  condi¬ 
tion,  along  with  the  human  data,  is  illustrated  in  panel 
Aof  Figure  17.4.  'The  model  closely  captures  all  of  the 
phenomena  of  interest.  The  largest  discrepancy 
between  the  two  data  sets  is  that  the  human  partici¬ 
pants’  alert  responses  tend  to  he  somewhat  faster  than 
the  model’s.  'This  may  reflect  an  attentional  strategy  in 
use  by  the  participants,  but  not  implemented  in  the 
model.’  'The  accuracy  of  the  model’s  predictions  at 
baseline  is  matched  by  the  predictions  it  makes  for  per¬ 
formance  after  one,  hvo,  and  three  davs  without  sleep, 
as  shown  in  panels  B,  C,  and  0  of  Figure  1 7.4,  respec¬ 
tively.  The  model  captures  the  increase  in  false  starts, 
the  shift  in  alert  response  times,  and  the  increases  in 
lapses  and  sleep  attacks.  For  all  four  days,  the  perform¬ 
ance  of  the  model  closely  matches  the  human  data. 
Overall,  the  correlation  between  the  hnman  data  and 
the  model  predictions  is  0.99  (root  mean  square  devia¬ 
tion  =  0.0047). 


Response  Time  (ms) 


Response  Time  (ms) 


The  impact  of  decreasing  G  in  the  model  is  to 
reduce  the  likelihood  that  the  appropriate  productions 
will  have  LL  values  above  T^.  We  interpret  this  sit\ia- 
tion  as  reduced  arousal  (i.e.,  AC  T-R  gets  sleepy),  w’ith 
the  impact  being  that  the  appropriate  productions  are 
not  executed.  The  reduction  in  arousal  relative  to  the 
level  of  com|)ensation  immediately  decreases  the  like¬ 
lihood  that  a  fast  response  will  be  made.  Thus,  there  is 
a  shift  in  the  distribution  of  reaction  times  to  the  right, 
w'ith  progressively  fewer  fast  responses  as  (»  gets  lower. 
The  decrease  in  frequency  of  fast  responses  has  sec¬ 
ondary  effects.  Fach  time  an  opportimit)-  to  respond  is 
missed  (idle  cycles),  G  is  decremented.  This  makes  the 
model  less  likely  to  respond  at  the  next  opportnnitv'.  So 
the  impact  of  lower  arousal  accumulates  to  produce 
many  more  lapses,  along  with  more  sleej)  attacks. 

Finally,  the  false  starts  in  the  model  increase  simi¬ 
larly  to  the  human  data.  This  is  primarily  a  side  effect 
of  the  compensation  in  the  model,  reflected  by  the 
decreased  values  for  7',^.  As  T„  decreases,  it  is  more 
likely  that  the  value  for  LT  for  the  production  that  pro¬ 
duces  a  false  start  (i.e.,  just  click)  will  have  a  (./  that 


Response  Time  (ms) 


Response  Time  (ms) 


FicuiRi'  17.4  Human  data  and  model  performance  for  each  day  of  the  88-hr  total  sleep  deprivation  protocol  (data 
from  Van  Dongen  et  al.,  2001;  Van  Dongen,  2004). 
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rises  aliovc  lliresliolcl.  ITuis,  the  ineeliaiiism  for  coiii- 
pciisatioii  produces  an  undesirable  behavioral  consc- 
c|uenec  in  llie  model  that  matches  Ihe  human  data; 
namely,  an  increased  likelihood  of  responding  before 
the  stimulus  appears.  It  is  also  the  case  that  the  decrease 
in  C  contributes  to  this  effect  (though  to  a  lesser  extent), 
since  changes  in  G  do  nol  impact  for  the  iuxt-click 
production  (because  P  —  0  tor  this  production).  1  he 
combinalion  of  these  two  aspects  of  Ihe  model  produces 
an  increase  in  the  probability  of  producing  a  false  start 
that  lines  up  with  the  data  from  the  human  participants. 

General  Discussion 

'I'he  model  described  accurately  captures  Ihe  impact 
of  sleep  deprivation  on  human  performance  on  the 
PVT.  The  mechanisms  that  were  implemented  are 
based  on  research  within  the  ACTI'-R  community,  com¬ 
bined  with  ncurobehavioral  evidence  concerning  the 
impact  of  fatigue  on  brain  activity.  I  his  illustrates  the 
potential  for  using  midtipic  constraints  from  diverse 
research  communities  to  develop  an  understanding  of 
cognitive  mechanisms  that  impact  performance.  The 
ultimate  goal  of  ihis  work  is  to  develo])  a  general  set  of 
mechanisms  for  understanding  how  fatigue  impacts 
the  human  cognitive  system.  The  mechanisms  must 
specify  the  relalionshii>  between  fatigue  and  cognitive 
control,  even  if  it  is  not  done  explicitly.  ACT-R  has 
components  that  correspond  to  the  distinelion  between 
Type  1,  or  centralized,  control  and  Type  2  control,  or 
Ihe  internal  control  of  tunctional  processes. 

T  he  central  production  svsteni  represents  the  I  Vpe 
1  control  in  ACT-R,  while  the  other  modules  represent 
T  ype  2  control  structures.  T  he  production  cycle  drives 
behavior  in  ACT-R  models  ami  directs  Ihe  operation  of 
the  other  modules.  Other  modides  respond  to  requests 
from  the  production  system  by  producing  actions  (e.g., 
motor  movements  or  shifts  of  visual  attention)  or  by 
perfonniTig  some  operation  and  making  Ihe  residts 
available  to  the  production  system  (e.g..  a  retrieval 
from  declarative  memor\). 

At  one  extreme,  alcrtne.ss  could  be  implemented  as 
a  .separate  module  in  ,'\GT-R  that  operates  as  a  Type  2 
control  structure  to  influence  central  cognition.  M  the 
other  extreme,  alertness  could  he  viewed  as  a  compo¬ 
nent  of  the  T  ype  1  control  system. ■*  VVe  are  nol  com¬ 
mitted  to  a  particular  view  of  how  sleep  deprivation  fits 
with  cognitive  control.  Our  model  re|)resents  fatigue 
as  a  set  ot  mechanisms  that  operate  on  the  central 


production  system  in  ACT-R.  Decreased  arousal  (G) 
and  a  lower  utility  threshold  {TJ  both  involve  the  cen¬ 
tral  production  sy.stem  and  influence  the  actions  that 
are  taken  by  the  model.  T  he  performance  decrements 
in  the  other  modules  stem  from  productions  failing  to 
fire  to  send  the  appropriate  requests.  Still,  the  model 
has  little  to  .say  about  whether  those  mechanisms  are 
part  of  the  Type  1  control  structure  or  are  a  separate, 
Tvpc  2,  control  structure.  T  his  is  because  the  driving 
force  behind  Ihe  fatigue  mechanisms  is  not  yet  inte¬ 
grated  into  the  ACT'-R  architecture.  Specifically,  the 
biomathematical  models  of  alertness,  which  we  intend 
to  iKse  to  drive  the  parameter  changes,  are  currently 
outside  the  architecture.  1  low  they  are  represented  in 
the  architecture  could  have  important  implications  for 
our  understanding  of  how  cognitive  moderators  like 
fatigue  operate. 

In  the  current  model,  the  deficits  in  pertormance 
that  develop  with  diminished  alertness  represent  a 
breakdown  in  T  ype  1  control,  where  appropriate  actions 
are  no  longer  taken.  Increases  in  the  frequency  of  idle 
cognitive  cycles  produces  a  reduction  and  shift  in  alert 
response  times.  In  addition,  when  the  model  is  idle 
arousal  continues  to  fall,  making  the  model  progres¬ 
sively  less  likely  to  respond,  livsentially,  the  Type  1  con¬ 
trol  in  the  model  disappears,  as  the  central  production 
system  ceases  to  drive  behavior  forward.  The  model 
has,  in  es.sence,  gone  to  sleep.  Liven  though  false  starts 
are  a  consequence  of  a  production  becoming  more 
likely  to  fire,  this  effect  still  represents  a  breakdown  in 
control,  since  the  production  has  a  low  probability  of 
success.  More  generally,  with  the  current  mechanism 
for  decreasing  arou.sal  and  conipensation,  ACT-R 
becomes  less  able  to  differentiate  between  successful 
and  unsuccessful  productions.  The  effect  is  more 
erratic  (i.e.,  unstable)  performance,  just  as  is  found  in 
human  participants  who  are  deprived  of  sleep  (Doran, 
etal.  2001). 

It  is  nol  the  case  that  all  of  the  effects  must  come 
through  interaction  with  T  ype  1  control.  \Vc  have  con¬ 
sidered  an  alternative  mechanism  for  producing  false 
starts  that  involves  proces,ses  within  the  motor  module. 
In  ACT’-R,  motor  actions  can  be  preplanned  so  that  they 
can  be  executed  more  rapidiv.  Tvpe  1  control  guides 
the  execution  oi  the  planned  action.  It  is  possible  that  one 
of  the  effects  of  fatigue  is  to  increa.se  the  likelihood  that 
planned  actions  are  inadvertently  executed  without 
direction  from  the  central  production  system.  There  is 
evidence  that  increased  levels  of  fatigue  may  reduce 
cognitive  inhibition  (e.g.,  Harrison  &  Horne,  1998). 
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Thus,  if  planned  actions  are  held  back  using  a  process 
like  inhibition,  then  sleep  deprivation  could  result  in 
more  frequent  false  starts  through  a  breakdown  in 
lype  2  control.  We  have  not  iniplcnreiitcd  this  alterna¬ 
tive,  partly  because  the  current  .XCT-R  arehileeture 
does  not  include  incchanisins  for  inhibiting  motor 
movements  that  could  he  maiiiprdated  to  produce  this 
effect.  However,  it  provides  au  interesting  possibility 
for  future  research. 

T  his  alternative  inechauism  for  lalse  alarms  raises 
an  important  issue  for  understanding  tatigne.  If  it  is  the 
case  that  fatigue  can  directly  influence  one  Type  2 
control  structure,  like  a  motor  module,  then  prc.siuu- 
ably  other  modules  may  he  affected  as  well.  Such  a 
conclusion  would  suggest  that  sleep  deprivation  has 
effects  that  transcend  the  distinction  hetweeu  T\pc  1 
and  Type  2  control.  T  hat  is,  it  is  possible  that  sleep 
deprivation  influences  mechanisms  associated  with 
Type  1  control  and  Type  2  control. 

Conclusion 

We  have  presented  a  nrodel  that  performs  the  PV'T, 
combined  with  a  set  of  mechanisms  that  produces 
decrements  in  performance  on  that  task,  which  mirror 
the  effect  of  sleep  loss  in  human  partieipauts.  T  he 
mechanisms  iinplcmentcd  in  the  model  were  based 
on  previous  research,  both  in  the  ACT-R  counuuuih’ 
and  on  the  nenrobehavioral  impacts  of  sleep  loss.  The 
data  were  fit  at  the  level  of  average  performance  for 
each  day  of  the  study.  We  ha\  c  demonstrated  that  these 
mechanisms  produce  performance  changes  in  the 
model  that  closely  match  the  performance  changes  of 
human  participants  who  have  been  denied  sleep  over 
a  period  of  nearly  four  consecutive  days.  T  he  next  step 
is  to  fit  the  model  to  the  experimental  data  from  each 
10-ininute  session,  which  occurred  at  2-hour  intervals 
throughout  the  study.  This  effort  is  already  underway 
and  has  provided  further  support  for  our  approach.  We 
are  using  the  results  from  this  process  to  dexelop  a 
mapping  between  alertness  predictions  generated  by 
CN’PA  and  parameter  values  in  the  ACT-R  model. 
Once  the  appropriate  mapping  is  identified,  it  will  be 
used  to  validate  our  ability  to  make  a  priori  predictions 
about  human  performance  in  other  experimental 
protocols  and  for  other  tasks. 

A  major  challenge  for  validating  onr  model  lies  in 
its  ability  to  account  for  findings  from  a  variety  of  tasks. 
The  model’s  performance  on  tbe  lAT  is  almost  entirely 


de])cndent  on  ])roccdural  components  of  the  architec¬ 
ture;  the  only  declarative  kiunxTedge  needed  is  a  repre¬ 
sentation  of  the  goal.  It  will  be  interesting  to  see  whether 
additional  meehanisins  are  required  to  account  for 
changes  in  performance  associated  xvith  tasks  that 
require  more  declarative  knowledge.  For  instance,  \vc 
are  currently  developing  a  nrodel  for  a  serial  addition/ 
subtraction  task  (SAST),  which  relies  on  knowledge  of 
simple  (singic-rligit)  addition  and  subtraction  problems. 
Our  initial  examinations  of  the  model  for  this  task  sug¬ 
gest  that  the  procedural  mechanisnrs  that  produced 
the  effects  in  PV'T  may  not  be  suffieicirt  to  account  for 
the  changes  in  response  times  and  accuracy  on  the 
SAST’,  Phis  may  indicate  that  decreaserl  alertness 
effects  many  aspects  of  the  cognitive  system  simultane- 
ouslv.  Certainly,  other  areas  of  the  brain  show  changes 
in  activitx  as  a  function  ol  sleep  loss.  As  this  research 
progresses  and  matures,  we  hope  to  develop  a  compre¬ 
hensive,  mechanistic  explanation  of  the  changes  that 
occur  at  the  level  of  the  human  cognitive  architecture 
as  a  function  of  changes  in  alertness,  lb  do  this,  we 
will  continue  to  incorporate  as  many  theoretical  and 
empirical  constraints  as  we  can,  to  guide  the  identifi¬ 
cation  of  mechanisms  and  to  infornt  our  understanding 
of  the  processes  involved. 
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Notes 

1  In  AC'l-R,  noise  is  controlled  by  a  parameter,  s, 
whose  relation  to  the  variance  (cr-)  is  defined  by  the 
equation:  <7-  =  (;r-"s")/5.  In  this  model,  s  was  set  to  the 
default  .ACT-R  value  of  (1.25. 
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2.  ACri'-R  does  not  produce  idle  cycles  by  default.  This 
required  an  enliaiicenient  of  this  couiponent  of  the 
architecture,  and  we  arc  grateful  to  Oau  Bothell  for 
his  help  iinpleinenting  this.  In  addition,  cycle  times  in 
this  model  were  noisy,  w'liich  is  an  available  option  in 
,\CT-R.  T  he  duration  of  a  particular  cycle  in  the  model 
varied  between  25ms  and  75ms,  according  to  a  uniform 
distribution,  which  is  the  default  function  for  this  noise 
value  in  ACT-R. 

5.  The  implemented  model  does  not  explicitly  main¬ 
tain  attention  once  it  has  responded  to  the  .stimulus.  As  a 
result,  when  the  next  stimulus  appears,  an  extra  produc¬ 
tion  is  required  to  shift  attention  to  il.  With  a  prohabilistie 
mixture  of  this  process  and  one  that  mainlains  attention 
on  the  stimulus  location  between  trials,  the  distribution  of 
res|X)nse  times  can  be  captured  more  accurately.  1  lowever, 
the  better  fit  comes  at  the  cost  of  model  complexity,  w  hich 
seemed  unwarranted  for  the  current  modeling  effort. 

4.  It  is  possible  to  consider  a  third  option,  w  hich  is  that 
arousal  is  outside  cogTiitive  control  altogether  (i.e.,  it  is 
not  under  control).  However,  arousal  clearly  seem  to  affect 
aspects  of  control  in  cognition,  suggesting  that  it  operates 
through  these  structures,  if  not  as  one,  or  part,  of  them. 
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